Using jsPsych and cognition.run

Session 4 - intermediate/advanced

Translations available

Disclaimer: may not be very accurate…

Worksheet overview

Aims

By the end of this worksheet you should be able to:

  • program your own experiments in jsPsych
  • host the experiment online using cognition.run
  • use the participant data for analysis
  • apply the basic skills you have learnt for your own purposes
  • learn some extra skills such as HTML, javascript, CSS and JSON

Pre-requisites

To complete the aims you will need to:

  • follow this worksheet
  • ask questions if you are not sure/be able to google
  • have a working computer and internet connection
  • be patient when things do not work

You do not need to:

  • have any programming knowledge
  • have high computer literacy
  • know anything about jsPsych, cognition.run, html, css or javascript
  • be a linguist

Structure

The worksheet will go through the following sections:

  • Running other types of experiments

    • working with audio, images and video
    • self paced reading
    • conditional and if trials

  • Working with results files in R

    • loading in multiple files quickly
    • getting information from different parts of the experiment
    • converting json formatted data to columns

Recap

In the last session we should have:

  • Running in full screen mode
  • Presenting instructions
  • Using consent forms
  • Demographic questions
  • Feedback forms
  • Distributing links

Running other types of experiments

In this section, we will focus on different types of experiments that are more advanced than the lexical decision experiment we have already programmed.

audio stimuli

A common adaption to the lexical decision experiment is the auditory version, where instead of text on the screen the participant hears an audio recording. To run this type of experiment we will need to use audio files.

audio files

We will use a set of audio files that have the same words and non-words as we used in the text version.

You can download the audio files as a .zip folder at this link.

jspsych_audio_stimuli.zip

There should be 20 files, each named something like fox.wav.

In cognition.run we can now upload these files so that they are stored in the experiment. Click the browse button and choose the audio files that were in the .zip folder. You can select all the files and upload them in one go.

stimuli file

Now we need to update the stimuli file, so that we are reading in the audio .wav files, instead of the text.

To do this, we need to create a new version of our lexical_decision_stimuli.csv file.

Change each of the words in the item column so that there is .wav at the end, e.g. fox should be fox.wav.

Save the file as a .csv, called lexical_decision_stimuli.csv.

The data should look like this:

Now we need to go to R and process the .csv file to json format.

We can use the same code to go from csv to json to js as we did in session 2:

paste0("var stimuli = ",
       toJSON(read_delim("lexical_decision_stimuli_audio.csv", delim = ";"),
              pretty=TRUE),
       ";") %>%
  write_file(file = "lexical_decision_stimuli_audio_JSON.js")

We should now have a file called lexical_decision_stimuli_audio_JSON.js, which we can upload to cognition.run in the external JS/CSS section.

If you need this file, you can download it:

lexical_decision_stimuli_audio_JSON.js.

audio-keyboard-response

The last thing we need to change in our jspsych code is the plugin type.

In our code we should have:

var lexical_decision_trial = {
  type: jsPsychHtmlKeyboardResponse,
  stimulus: jsPsych.timelineVariable("item"),
  choices: ['d', 'h'],
  prompt: '<div style="font-size:12pt; position:relative; bottom:150px;">press "d" if you think it is a real word, press "h" if you think it is not a real word</div>',
  data: {
    task: 'lexical_decision',
    real_word: jsPsych.timelineVariable('real_word'),
    correct_key: jsPsych.timelineVariable('correct_key')
    }
};

But in order for our audio files to be read properly, we need to change the plugin type.

If we change the type argument from jsPsychHtmlKeyboardResponse to jsPsychAudioKeyboardResponse, we should now see that the experiment will play the audio files and not present the words.

So the final code for a simple auditory lexical decision experiment would be:

// --------
// Title: Demo experiment
// jsPsych version: 7.3.1
// date: [today]
// author: [your name]
//----------

// inititate jspsych
var jsPsych = initJsPsych();

// set up main timeline
var timeline = [];

var lexical_decision_trial = {
  type: jsPsychAudioKeyboardResponse,
  stimulus: jsPsych.timelineVariable("item"),
  choices: ['d', 'h'],
  prompt: '<div style="font-size:12pt; position:relative; bottom:150px;">press "d" if you think it is a real word, press "h" if you think it is not a real word</div>',
  data: {
    task: 'lexical_decision',
    real_word: jsPsych.timelineVariable('real_word'),
    correct_key: jsPsych.timelineVariable('correct_key')
    }
};

var fixation_trial = {
  type: jsPsychHtmlKeyboardResponse,
  stimulus: '<div style="font-size:30pt;">+</div>',
  choices: 'NO_KEYS',
  prompt: '<div style="font-size:10pt; position:relative; bottom:150px;"><br/></div>',
  trial_duration: 500,
  data: {
    task: 'fixation'
  }
};

var lexical_decision_combined = {
  timeline: [fixation_trial, lexical_decision_trial],
  timeline_variables: stimuli,
  randomize_order: true
};

timeline.push(lexical_decision_combined);

//run the experiment
jsPsych.run(timeline);

image stimuli

video stimuli

conditional and if trials

LS0tCnRpdGxlOiAiVXNpbmcganNQc3ljaCBhbmQgY29nbml0aW9uLnJ1biIKc3VidGl0bGU6ICJTZXNzaW9uIDQgLSBpbnRlcm1lZGlhdGUvYWR2YW5jZWQiCmF1dGhvcjogIkphbWVzIEJyYW5kIgpkYXRlOiAiYHIgZm9ybWF0KFN5cy50aW1lKCksICclZCAlQiwgJVknKWAiCm91dHB1dDoKICBybWRmb3JtYXRzOjpyZWFkdGhlZG93bjoKICAgIHBhbmRvY19hcmdzOiAiLS1oaWdobGlnaHQtc3R5bGU9bXkudGhlbWUiCiAgICBoaWdobGlnaHQ6IHB5Z21lbnRzCiAgICB0b2NfZmxvYXQ6IHRydWUKICAgIGNvZGVfZG93bmxvYWQ6IHRydWUKICAgIHRvY19kZXB0aDogMwogICAgY29sbGFwc2VkOiBmYWxzZQogICAgZGZfcHJpbnQ6IHBhZ2VkCiAgICBsaWdodGJveDogVFJVRQogICAgZ2FsbGVyeTogVFJVRQogICAgY3NzOiAiY3NzL3N0eWxlLmNzcyIKICAgIAotLS0KCmBgYHtyIGVjaG89RkFMU0UsIHdhcm5pbmc9RkFMU0V9CmxpYnJhcnkoc2xpY2tSKQpsaWJyYXJ5KGh0bWx0b29scykKbGlicmFyeSh4YXJpbmdhbkV4dHJhKQpsaWJyYXJ5KHJtYXJrZG93bikKbGlicmFyeShmb250YXdlc29tZSkKbGlicmFyeShic3BsdXMpCmxpYnJhcnkoRFQpCgpgYGAKCmBgYHtyIHNldHVwLCB3YXJuaW5nPUZBTFNFLCBlY2hvPUZBTFNFfQprbml0cjo6b3B0c19jaHVuayRzZXQoZWNobyA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICBldmFsID0gRkFMU0UsCiAgICAgICAgICAgICAgICAgICAgICBjb21tZW50ID0gTkEsCiAgICAgICAgICAgICAgICAgICAgICBtZXNzYWdlID0gRkFMU0UsCiAgICAgICAgICAgICAgICAgICAgICB3YXJuaW5nID0gRkFMU0UpCgprbml0cjo6a25pdF9ob29rcyRzZXQoCiAgbWVzc2FnZSA9IGZ1bmN0aW9uKHgsIG9wdGlvbnMpIHsKICAgICBwYXN0ZSgnPGJ1dHRvbiB0eXBlPSJidXR0b24iIGNsYXNzPSJjb2xsYXBzaWJsZTEiPjxzdHJvbmc+JywKICAgICBmYShuYW1lID0gImNpcmNsZS1pbmZvIiksCiAgICAgJyBtb3JlIGluZm88L3N0cm9uZz48L2J1dHRvbj4nLCAnPGRpdiBjbGFzcz0iY29udGVudDEiPjxwPicsCiAgICAgZ3N1YignIyMnLCAnXG4nLCB4KSwKICAgICAnPC9wPjwvZGl2PicsCiAgICAgc2VwID0gJ1xuJykKICAgfSkKCmNvZGVibG9jayA9IGZ1bmN0aW9uKHgsIG9wdGlvbnMpIHsKICAgICBjYXQocGFzdGUoJzxkaXYgY2xhc3M9ImNvZGVibG9jayI+JywKICAgICBwYXN0ZTAoeCksCiAgICAgJzwvZGl2PicsCiAgICAgc2VwID0gJ1xuJykpCiAgIH0KCmBgYAoKLS0tCgojIyBgciBmYSgibGFuZ3VhZ2UiKWAgVHJhbnNsYXRpb25zIGF2YWlsYWJsZQoKRGlzY2xhaW1lcjogbWF5IG5vdCBiZSB2ZXJ5IGFjY3VyYXRlLi4uCgo8ZGl2IGlkPSJnb29nbGVfdHJhbnNsYXRlX2VsZW1lbnQiPjwvZGl2PgoKLS0tCgojIFdvcmtzaGVldCBvdmVydmlldwoKIyMgYHIgZmEoImNyb3NzaGFpcnMiKWAgQWltcwoKQnkgdGhlIGVuZCBvZiB0aGlzIHdvcmtzaGVldCB5b3Ugc2hvdWxkIGJlIGFibGUgdG86CgotICoqcHJvZ3JhbSoqIHlvdXIgb3duIGV4cGVyaW1lbnRzIGluIGpzUHN5Y2gKLSAqKmhvc3QqKiB0aGUgZXhwZXJpbWVudCBvbmxpbmUgdXNpbmcgY29nbml0aW9uLnJ1bgotICoqdXNlKiogdGhlIHBhcnRpY2lwYW50IGRhdGEgZm9yIGFuYWx5c2lzCi0gKiphcHBseSoqIHRoZSBiYXNpYyBza2lsbHMgeW91IGhhdmUgbGVhcm50IGZvciB5b3VyIG93biBwdXJwb3NlcwotICoqbGVhcm4qKiBzb21lIGV4dHJhIHNraWxscyBzdWNoIGFzIEhUTUwsIGphdmFzY3JpcHQsIENTUyBhbmQgSlNPTgoKIyMgYHIgZmEoInVzZXItZ3JhZHVhdGUiKWAgUHJlLXJlcXVpc2l0ZXMKClRvIGNvbXBsZXRlIHRoZSBhaW1zIHlvdSB3aWxsIG5lZWQgdG86CgotICoqZm9sbG93KiogdGhpcyB3b3Jrc2hlZXQKLSAqKmFzayoqIHF1ZXN0aW9ucyBpZiB5b3UgYXJlIG5vdCBzdXJlL2JlIGFibGUgdG8gZ29vZ2xlCi0gKipoYXZlKiogYSB3b3JraW5nIGNvbXB1dGVyIGFuZCBpbnRlcm5ldCBjb25uZWN0aW9uCi0gKipiZSBwYXRpZW50Kiogd2hlbiB0aGluZ3MgZG8gbm90IHdvcmsKCllvdSBkbyBub3QgbmVlZCB0bzoKCi0gaGF2ZSBhbnkgKipwcm9ncmFtbWluZyBrbm93bGVkZ2UqKgotIGhhdmUgaGlnaCAqKmNvbXB1dGVyIGxpdGVyYWN5KioKLSBrbm93IGFueXRoaW5nIGFib3V0ICoqanNQc3ljaCwgY29nbml0aW9uLnJ1biwgaHRtbCwgY3NzIG9yIGphdmFzY3JpcHQqKgotIGJlIGEgKipsaW5ndWlzdCoqCgojIyBgciBmYSgiZm9sZGVyLXRyZWUiKWAgU3RydWN0dXJlCgpUaGUgd29ya3NoZWV0IHdpbGwgZ28gdGhyb3VnaCB0aGUgZm9sbG93aW5nIHNlY3Rpb25zOgoKLSBSdW5uaW5nIG90aGVyIHR5cGVzIG9mIGV4cGVyaW1lbnRzCgogICAgLSB3b3JraW5nIHdpdGggYXVkaW8sIGltYWdlcyBhbmQgdmlkZW8KICAgIC0gc2VsZiBwYWNlZCByZWFkaW5nCiAgICAtIGNvbmRpdGlvbmFsIGFuZCBpZiB0cmlhbHMKPGJyLz48YnIvPgotIFdvcmtpbmcgd2l0aCByZXN1bHRzIGZpbGVzIGluIFIKCiAgICAtIGxvYWRpbmcgaW4gbXVsdGlwbGUgZmlsZXMgcXVpY2tseQogICAgLSBnZXR0aW5nIGluZm9ybWF0aW9uIGZyb20gZGlmZmVyZW50IHBhcnRzIG9mIHRoZSBleHBlcmltZW50CiAgICAtIGNvbnZlcnRpbmcganNvbiBmb3JtYXR0ZWQgZGF0YSB0byBjb2x1bW5zCgojIyBgciBmYSgibGlnaHRidWxiIilgIFJlY2FwCgpJbiB0aGUgbGFzdCBzZXNzaW9uIHdlIHNob3VsZCBoYXZlOgoKLSBSdW5uaW5nIGluIGZ1bGwgc2NyZWVuIG1vZGUKLSBQcmVzZW50aW5nIGluc3RydWN0aW9ucwotIFVzaW5nIGNvbnNlbnQgZm9ybXMKLSBEZW1vZ3JhcGhpYyBxdWVzdGlvbnMKLSBGZWVkYmFjayBmb3JtcwotIERpc3RyaWJ1dGluZyBsaW5rcwoKLS0tCgo8IS0tICMgV29ya2luZyB3aXRoIHJlc3VsdHMgZmlsZXMgaW4gUiAtLT4KCjwhLS0gIyMgbG9hZGluZyBpbiBtdWx0aXBsZSBmaWxlcyBxdWlja2x5IC0tPgoKPCEtLSAjIyBnZXR0aW5nIGluZm9ybWF0aW9uIGZyb20gZGlmZmVyZW50IHBhcnRzIG9mIHRoZSBleHBlcmltZW50IC0tPgoKPCEtLSAjIyBjb252ZXJ0aW5nIGpzb24gZm9ybWF0dGVkIGRhdGEgdG8gY29sdW1ucyAtLT4KCgoKCiMgUnVubmluZyBvdGhlciB0eXBlcyBvZiBleHBlcmltZW50cwoKSW4gdGhpcyBzZWN0aW9uLCB3ZSB3aWxsIGZvY3VzIG9uIGRpZmZlcmVudCB0eXBlcyBvZiBleHBlcmltZW50cyB0aGF0IGFyZSBtb3JlIGFkdmFuY2VkIHRoYW4gdGhlIGxleGljYWwgZGVjaXNpb24gZXhwZXJpbWVudCB3ZSBoYXZlIGFscmVhZHkgcHJvZ3JhbW1lZC4KCiMgYXVkaW8gc3RpbXVsaQoKQSBjb21tb24gYWRhcHRpb24gdG8gdGhlIGxleGljYWwgZGVjaXNpb24gZXhwZXJpbWVudCBpcyB0aGUgYXVkaXRvcnkgdmVyc2lvbiwgd2hlcmUgaW5zdGVhZCBvZiB0ZXh0IG9uIHRoZSBzY3JlZW4gdGhlIHBhcnRpY2lwYW50IGhlYXJzIGFuIGF1ZGlvIHJlY29yZGluZy4gVG8gcnVuIHRoaXMgdHlwZSBvZiBleHBlcmltZW50IHdlIHdpbGwgbmVlZCB0byB1c2UgYXVkaW8gZmlsZXMuCgojIyBhdWRpbyBmaWxlcwoKV2Ugd2lsbCB1c2UgYSBzZXQgb2YgYXVkaW8gZmlsZXMgdGhhdCBoYXZlIHRoZSBzYW1lIHdvcmRzIGFuZCBub24td29yZHMgYXMgd2UgdXNlZCBpbiB0aGUgdGV4dCB2ZXJzaW9uLgoKWW91IGNhbiBkb3dubG9hZCB0aGUgYXVkaW8gZmlsZXMgYXMgYSAuemlwIGZvbGRlciBhdCB0aGlzIGxpbmsuCgpgciBmYSgiZG93bmxvYWQiKWAgW2pzcHN5Y2hfYXVkaW9fc3RpbXVsaS56aXBdKGh0dHBzOi8vZ2l0aHViLmNvbS9qYW1lc2JyYW5kc2NpZW5jZS9qc3BzeWNoLXR1dG9yaWFsL3Jhdy9tYWluL2pzcHN5Y2hfYXVkaW9fc3RpbXVsaS56aXApCgpUaGVyZSBzaG91bGQgYmUgMjAgZmlsZXMsIGVhY2ggbmFtZWQgc29tZXRoaW5nIGxpa2UgYGZveC53YXZgLgoKSW4gY29nbml0aW9uLnJ1biB3ZSBjYW4gbm93IHVwbG9hZCB0aGVzZSBmaWxlcyBzbyB0aGF0IHRoZXkgYXJlIHN0b3JlZCBpbiB0aGUgZXhwZXJpbWVudC4gQ2xpY2sgdGhlIGBicm93c2VgIGJ1dHRvbiBhbmQgY2hvb3NlIHRoZSBhdWRpbyBmaWxlcyB0aGF0IHdlcmUgaW4gdGhlIC56aXAgZm9sZGVyLiBZb3UgY2FuIHNlbGVjdCBhbGwgdGhlIGZpbGVzIGFuZCB1cGxvYWQgdGhlbSBpbiBvbmUgZ28uCgohW10oaW1hZ2VzL2NvZ25pdGlvbl9zdGltdWxpLnBuZykKCiMjIHN0aW11bGkgZmlsZQoKTm93IHdlIG5lZWQgdG8gdXBkYXRlIHRoZSBzdGltdWxpIGZpbGUsIHNvIHRoYXQgd2UgYXJlIHJlYWRpbmcgaW4gdGhlIGF1ZGlvIGAud2F2YCBmaWxlcywgaW5zdGVhZCBvZiB0aGUgdGV4dC4KClRvIGRvIHRoaXMsIHdlIG5lZWQgdG8gY3JlYXRlIGEgbmV3IHZlcnNpb24gb2Ygb3VyIGBsZXhpY2FsX2RlY2lzaW9uX3N0aW11bGkuY3N2YCBmaWxlLgoKQ2hhbmdlIGVhY2ggb2YgdGhlIHdvcmRzIGluIHRoZSBgaXRlbWAgY29sdW1uIHNvIHRoYXQgdGhlcmUgaXMgYC53YXZgIGF0IHRoZSBlbmQsIGUuZy4gYGZveGAgc2hvdWxkIGJlIGBmb3gud2F2YC4KClNhdmUgdGhlIGZpbGUgYXMgYSAuY3N2LCBjYWxsZWQgYGxleGljYWxfZGVjaXNpb25fc3RpbXVsaS5jc3ZgLgoKVGhlIGRhdGEgc2hvdWxkIGxvb2sgbGlrZSB0aGlzOgoKYGBge3IgZWNobz1GQUxTRSwgZXZhbD1UUlVFLCB3YXJuaW5nPUZBTFNFfQpkYXRhdGFibGUoZGF0YS5mcmFtZShpdGVtID0gYygiZm94LndhdiIsICJjaGVlc2Uud2F2IiwgInNoZWVwLndhdiIsICJiYW5hbmEud2F2IiwgImNoYWlyLndhdiIsICJwZWEud2F2IiwgImhlYXJ0LndhdiIsICJwdW1wa2luLndhdiIsICJjdWN1bWJlci53YXYiLCAiaGlwcG8ud2F2IiwgImZ6eC53YXYiLCAiY2hlZXN4LndhdiIsICJzaHh4cC53YXYiLCAiYmFueG5hLndhdiIsICJjaHhpci53YXYiLCAicHhhLndhdiIsICJoZXhydC53YXYiLCAicHVtcGt4bi53YXYiLCAiY3hjdW1iZXIud2F2IiwgImh4cHBvLndhdiIpLAogICAgICAgICAgICAgICAgIHJlYWxfd29yZCA9IGMocmVwKCJ5ZXMiLCAxMCksIHJlcCgibm8iLCAxMCkpLAogICAgICAgICAgICAgICAgIGNvcnJlY3Rfa2V5ID0gYyhyZXAoImQiLCAxMCksIHJlcCgiaCIsIDEwKSkpLCByb3duYW1lcyA9IEZBTFNFLCBmaWx0ZXIgPSAibm9uZSIsIGF1dG9IaWRlTmF2aWdhdGlvbiA9IFRSVUUsIG9wdGlvbnMgPSBsaXN0KGRvbSA9ICd0JywgcGFnZUxlbmd0aCA9IDIwKSkKCmBgYAoKTm93IHdlIG5lZWQgdG8gZ28gdG8gUiBhbmQgcHJvY2VzcyB0aGUgLmNzdiBmaWxlIHRvIGpzb24gZm9ybWF0LgoKV2UgY2FuIHVzZSB0aGUgc2FtZSBjb2RlIHRvIGdvIGZyb20gY3N2IHRvIGpzb24gdG8ganMgYXMgd2UgZGlkIGluIHNlc3Npb24gMjoKCmBgYHtyIGV2YWw9RkFMU0UsIGVjaG89VFJVRX0KcGFzdGUwKCJ2YXIgc3RpbXVsaSA9ICIsCiAgICAgICB0b0pTT04ocmVhZF9kZWxpbSgibGV4aWNhbF9kZWNpc2lvbl9zdGltdWxpX2F1ZGlvLmNzdiIsIGRlbGltID0gIjsiKSwKICAgICAgICAgICAgICBwcmV0dHk9VFJVRSksCiAgICAgICAiOyIpICU+JQogIHdyaXRlX2ZpbGUoZmlsZSA9ICJsZXhpY2FsX2RlY2lzaW9uX3N0aW11bGlfYXVkaW9fSlNPTi5qcyIpCgpgYGAKCldlIHNob3VsZCBub3cgaGF2ZSBhIGZpbGUgY2FsbGVkIGBsZXhpY2FsX2RlY2lzaW9uX3N0aW11bGlfYXVkaW9fSlNPTi5qc2AsIHdoaWNoIHdlIGNhbiB1cGxvYWQgdG8gY29nbml0aW9uLnJ1biBpbiB0aGUgYGV4dGVybmFsIEpTL0NTU2Agc2VjdGlvbi4KCklmIHlvdSBuZWVkIHRoaXMgZmlsZSwgeW91IGNhbiBkb3dubG9hZCBpdDoKCmByIGZhKCJkb3dubG9hZCIpYCBbbGV4aWNhbF9kZWNpc2lvbl9zdGltdWxpX2F1ZGlvX0pTT04uanNdKGh0dHBzOi8vZ2l0aHViLmNvbS9qYW1lc2JyYW5kc2NpZW5jZS9qc3BzeWNoLXR1dG9yaWFsL3Jhdy9tYWluL2xleGljYWxfZGVjaXNpb25fc3RpbXVsaV9KU09OLmpzKS4KCiMjIGF1ZGlvLWtleWJvYXJkLXJlc3BvbnNlCgpUaGUgbGFzdCB0aGluZyB3ZSBuZWVkIHRvIGNoYW5nZSBpbiBvdXIganNwc3ljaCBjb2RlIGlzIHRoZSBwbHVnaW4gdHlwZS4KCkluIG91ciBjb2RlIHdlIHNob3VsZCBoYXZlOgoKYGBge2pzfQp2YXIgbGV4aWNhbF9kZWNpc2lvbl90cmlhbCA9IHsKICB0eXBlOiBqc1BzeWNoSHRtbEtleWJvYXJkUmVzcG9uc2UsCiAgc3RpbXVsdXM6IGpzUHN5Y2gudGltZWxpbmVWYXJpYWJsZSgiaXRlbSIpLAogIGNob2ljZXM6IFsnZCcsICdoJ10sCiAgcHJvbXB0OiAnPGRpdiBzdHlsZT0iZm9udC1zaXplOjEycHQ7IHBvc2l0aW9uOnJlbGF0aXZlOyBib3R0b206MTUwcHg7Ij5wcmVzcyAiZCIgaWYgeW91IHRoaW5rIGl0IGlzIGEgcmVhbCB3b3JkLCBwcmVzcyAiaCIgaWYgeW91IHRoaW5rIGl0IGlzIG5vdCBhIHJlYWwgd29yZDwvZGl2PicsCiAgZGF0YTogewogICAgdGFzazogJ2xleGljYWxfZGVjaXNpb24nLAogICAgcmVhbF93b3JkOiBqc1BzeWNoLnRpbWVsaW5lVmFyaWFibGUoJ3JlYWxfd29yZCcpLAogICAgY29ycmVjdF9rZXk6IGpzUHN5Y2gudGltZWxpbmVWYXJpYWJsZSgnY29ycmVjdF9rZXknKQogICAgfQp9OwoKYGBgCgpCdXQgaW4gb3JkZXIgZm9yIG91ciBhdWRpbyBmaWxlcyB0byBiZSByZWFkIHByb3Blcmx5LCB3ZSBuZWVkIHRvIGNoYW5nZSB0aGUgcGx1Z2luIHR5cGUuCgpJZiB3ZSBjaGFuZ2UgdGhlIGB0eXBlYCBhcmd1bWVudCBmcm9tIGBqc1BzeWNoSHRtbEtleWJvYXJkUmVzcG9uc2VgIHRvIGBqc1BzeWNoQXVkaW9LZXlib2FyZFJlc3BvbnNlYCwgd2Ugc2hvdWxkIG5vdyBzZWUgdGhhdCB0aGUgZXhwZXJpbWVudCB3aWxsIHBsYXkgdGhlIGF1ZGlvIGZpbGVzIGFuZCBub3QgcHJlc2VudCB0aGUgd29yZHMuCgpTbyB0aGUgZmluYWwgY29kZSBmb3IgYSBzaW1wbGUgYXVkaXRvcnkgbGV4aWNhbCBkZWNpc2lvbiBleHBlcmltZW50IHdvdWxkIGJlOgoKYGBge2pzfQovLyAtLS0tLS0tLQovLyBUaXRsZTogRGVtbyBleHBlcmltZW50Ci8vIGpzUHN5Y2ggdmVyc2lvbjogNy4zLjEKLy8gZGF0ZTogW3RvZGF5XQovLyBhdXRob3I6IFt5b3VyIG5hbWVdCi8vLS0tLS0tLS0tLQoKLy8gaW5pdGl0YXRlIGpzcHN5Y2gKdmFyIGpzUHN5Y2ggPSBpbml0SnNQc3ljaCgpOwoKLy8gc2V0IHVwIG1haW4gdGltZWxpbmUKdmFyIHRpbWVsaW5lID0gW107Cgp2YXIgbGV4aWNhbF9kZWNpc2lvbl90cmlhbCA9IHsKICB0eXBlOiBqc1BzeWNoQXVkaW9LZXlib2FyZFJlc3BvbnNlLAogIHN0aW11bHVzOiBqc1BzeWNoLnRpbWVsaW5lVmFyaWFibGUoIml0ZW0iKSwKICBjaG9pY2VzOiBbJ2QnLCAnaCddLAogIHByb21wdDogJzxkaXYgc3R5bGU9ImZvbnQtc2l6ZToxMnB0OyBwb3NpdGlvbjpyZWxhdGl2ZTsgYm90dG9tOjE1MHB4OyI+cHJlc3MgImQiIGlmIHlvdSB0aGluayBpdCBpcyBhIHJlYWwgd29yZCwgcHJlc3MgImgiIGlmIHlvdSB0aGluayBpdCBpcyBub3QgYSByZWFsIHdvcmQ8L2Rpdj4nLAogIGRhdGE6IHsKICAgIHRhc2s6ICdsZXhpY2FsX2RlY2lzaW9uJywKICAgIHJlYWxfd29yZDoganNQc3ljaC50aW1lbGluZVZhcmlhYmxlKCdyZWFsX3dvcmQnKSwKICAgIGNvcnJlY3Rfa2V5OiBqc1BzeWNoLnRpbWVsaW5lVmFyaWFibGUoJ2NvcnJlY3Rfa2V5JykKICAgIH0KfTsKCnZhciBmaXhhdGlvbl90cmlhbCA9IHsKICB0eXBlOiBqc1BzeWNoSHRtbEtleWJvYXJkUmVzcG9uc2UsCiAgc3RpbXVsdXM6ICc8ZGl2IHN0eWxlPSJmb250LXNpemU6MzBwdDsiPis8L2Rpdj4nLAogIGNob2ljZXM6ICdOT19LRVlTJywKICBwcm9tcHQ6ICc8ZGl2IHN0eWxlPSJmb250LXNpemU6MTBwdDsgcG9zaXRpb246cmVsYXRpdmU7IGJvdHRvbToxNTBweDsiPjxici8+PC9kaXY+JywKICB0cmlhbF9kdXJhdGlvbjogNTAwLAogIGRhdGE6IHsKICAgIHRhc2s6ICdmaXhhdGlvbicKICB9Cn07Cgp2YXIgbGV4aWNhbF9kZWNpc2lvbl9jb21iaW5lZCA9IHsKICB0aW1lbGluZTogW2ZpeGF0aW9uX3RyaWFsLCBsZXhpY2FsX2RlY2lzaW9uX3RyaWFsXSwKICB0aW1lbGluZV92YXJpYWJsZXM6IHN0aW11bGksCiAgcmFuZG9taXplX29yZGVyOiB0cnVlCn07Cgp0aW1lbGluZS5wdXNoKGxleGljYWxfZGVjaXNpb25fY29tYmluZWQpOwoKLy9ydW4gdGhlIGV4cGVyaW1lbnQKanNQc3ljaC5ydW4odGltZWxpbmUpOwoKYGBgCgoKIyBpbWFnZSBzdGltdWxpCgojIHZpZGVvIHN0aW11bGkKCiMgY29uZGl0aW9uYWwgYW5kIGlmIHRyaWFscwoKCgpgYGB7ciBlY2hvPUZBTFNFLCBldmFsPVRSVUUsIHdhcm5pbmc9RkFMU0V9Cmh0bWx0b29sczo6dGFncyRzY3JpcHQoc3JjID0gImpzL3RyYW5zbGF0ZS5qcyIpCiMgaHRtbHRvb2xzOjp0YWdzJHNjcmlwdChzcmMgPSAianMvaW5mb2JveC5qcyIpCmh0bWx0b29sczo6dGFncyRzY3JpcHQoc3JjPSIvL3RyYW5zbGF0ZS5nb29nbGUuY29tL3RyYW5zbGF0ZV9hL2VsZW1lbnQuanM/Y2I9Z29vZ2xlVHJhbnNsYXRlRWxlbWVudEluaXQiKQoKaHRtbHRvb2xzOjp0YWdMaXN0KAogIHhhcmluZ2FuRXh0cmE6OnVzZV9jbGlwYm9hcmQoCiAgICBidXR0b25fdGV4dCA9ICI8aSBjbGFzcz1cImZhIGZhLWNsaXBib2FyZFwiIHN0eWxlPVwiZm9udC1zaXplOiAyNXB4XCI+PC9pPiIsCiAgICBzdWNjZXNzX3RleHQgPSAiPGkgY2xhc3M9XCJmYSBmYS1jaGVja1wiIHN0eWxlPVwiY29sb3I6ICM5MEJFNkQ7IGZvbnQtc2l6ZTogMjVweFwiPjwvaT4iLAogICksCiAgcm1hcmtkb3duOjpodG1sX2RlcGVuZGVuY3lfZm9udF9hd2Vzb21lKCkKKQoKYGBgCgpgYGB7anMgZWNobz1GQUxTRSwgZXZhbD1UUlVFfQp2YXIgY29sbCA9IGRvY3VtZW50LmdldEVsZW1lbnRzQnlDbGFzc05hbWUoImNvbGxhcHNpYmxlMSIpOwp2YXIgaTsKCmZvciAoaSA9IDA7IGkgPCBjb2xsLmxlbmd0aDsgaSsrKSB7CiAgY29sbFtpXS5hZGRFdmVudExpc3RlbmVyKCJjbGljayIsIGZ1bmN0aW9uKCkgewogICAgdGhpcy5jbGFzc0xpc3QudG9nZ2xlKCJhY3RpdmUxIik7CiAgICB2YXIgY29udGVudCA9IHRoaXMubmV4dEVsZW1lbnRTaWJsaW5nOwogICAgaWYgKGNvbnRlbnQuc3R5bGUubWF4SGVpZ2h0KXsKICAgICAgY29udGVudC5zdHlsZS5tYXhIZWlnaHQgPSBudWxsOwogICAgfSBlbHNlIHsKICAgICAgY29udGVudC5zdHlsZS5tYXhIZWlnaHQgPSBjb250ZW50LnNjcm9sbEhlaWdodCArICJweCI7CiAgICB9CiAgfSk7Cn0KCmBgYAo=